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Single exposure 3D imaging of dusty plasma clusters 
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We have worked out the details of a single camera, single exposure method to perform three-dimensional 
imaging of a finite particle cluster. The procedure is based on the plenoptic imaging principle and utilizes a 
commercial Lytro light field still camera. We demonstrate the capabilities of our technique on a single layer 
particle cluster in a dusty plasma, where the camera is aligned inclined at a small angle to the particle layer. 
The reconstruction of the third coordinate (depth) is found to be accurate and even shadowing particles can 
be identified. 



PACS numbers: 52.27.Lw, 07.05.Pj, 42.30.Wb 



I. INTRODUCTION 

Three dimensional imaging is in general a very chal- 
lenging task. With the rapid development of digital imag- 
ing and fast data processing capabilities, this field expe- 
rienced a boom in the recent years. The field of dusty 
plasma research is of no exception. Since the first par- 
allel reports on the observation of "plasma crystals"— ~—, 
which are usually situated in a horizontal plane, the main 
diagnostic tool in this field has been video microscopy 
combined with particle tracking velocimetry (PTV) . The 
need for accurate three-dimensional imaging was recog- 
nized soon after, when microgravity experiments started 
in spaced, on parabolic flights 6 , as well as with the dis- 
covery of Coulomb balls 7 and other "vertically extended" 
systems in the laboratory^. With 3D imaging being 
a generally unsolved issue, there is no straightforward 
"best" solution to record and track particle positions 
in these systems. Four different methods, of which the 
development was partially motivated by this field, have 
been successfully applied to analyze dust particle config- 
urations. These are: the slicing method^, stereoscopyi^, 
the color gradient methodic, and digital holography 12 . 
All of these techniques, briefly reviewed in the next sec- 
tion, have their pros and cons. 

The aim of this work is to elaborate the details and 
to demonstrate the applicability of a new method utiliz- 
ing a single camera, where all three spatial coordinates 
can be reconstructed from a single short exposure of a 
dust particle cloud. The optical principle is known as 
the "plenoptic technique", proposed already in 1908 by 
Gabriel Lippmann— (who called it "integral photogra- 
phy"). It took, however over a century for his invention 
to evolve from an idea to a commercial product. In the 
year 2011 two companies introduced their solutions nam- 
ing them "light field" cameras. The Lytro is a low cost, 



point-and-shoot type still camera, while the Raytrix is an 
industrial grade video solution with up to 180 frames per 
second at megapixel image resolution. Light field cam- 
eras provide the possibility to refocus the image after 
exposure by virtually displacing the image planed. 

Following a short introduction in Section |TT] to the ex- 
isting methods mentioned above, in Section IIIII we in- 
troduce our dusty plasma experiment. This is followed 
by the detailed description of our image processing and 
particle tracking method, in Section ITVl 



II. EXISTING METHODS 
A. Slicing method 

The slicing method is in principle a simple 2D method, 
where the target is illuminated by a thin laser sheet and 
the light scattered from the particles is captured by a 
digital camera positioned perpendicular to that layer. By 
moving the illumination together with the camera back 
and forth, a series of 2D slices are recorded. The re- 
construction of the depth is accomplished simply by as- 
sociating the slice number to the depth position of the 
illumination^. 

Advantage: 

• Low sensitivity to general lens properties like depth 
of field and perspective. 

Disadvantages: 

• Slow, as many exposures are needed for a single 
scan. 



Low depth resolution. 
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• Useful on static or very slowly evolving systems 
only, as every slice belongs to a different instance 
in time. 
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B. Stereoscopy 

Stereoscopy is the most intuitive and most popular 
technique, as it resembles the way of 3D vision as ex- 
isting in nature. The principle is simple: pointing 
two or more cameras to the same observation volume 
from different directions allows, in principle, perfect 3D 
reconstruction^. 

Advantage: 

• High frame-rates are possible (in typical applica- 
tions up to 150 fps), limited by the individual cam- 
eras, which have to operate synchronized. 

Disadvantages: 

• Expensive, as the cost increases linearly with the 
number of cameras used. 

• Low depth of field or low sensitivity due to low 
aperture (high f-number) used. 

• Problems with shadowing particles 

• Perspective problems. Can be solved by using tele- 
centric lenses, but those increase the installation 
expenses significantly. 

C. Color gradient method 

The color gradient method uses two (or more) cam- 
eras, which observe the volume of interest from the same 
direction but using complementing color filters. The il- 
lumination of the particle ensemble is performed using 
two colors with linear and opposite intensity gradients. 
For example the intensity of the red light decreases with 
increasing distance from the camera, while the blue inten- 
sity increases in the same direction. This way the depth 
information is simply given by the ratio of the apparent 
red and blue color intensities measured on each individual 
particleii. 

Advantages: 

• Simple mathematics needed for the reconstruction, 
which is less sensitive to lens and perspective prob- 
lems compared to stereoscopy. 

• Can be as fast as stereoscopy 
Disadvantages: 

• The use of laser sources for illumination seems to 
be straightforward, but due to their near perfect 
beam properties the strong angular dependence of 
the scattered light intensity, as described by the 
Mie scattering model, can result in misleading con- 
clusions. 

• High dynamic range (12 or 16 bit in intensity) 
needed to achieve a depth resolution comparable 
to the horizontal and vertical resolution. 



• Problems with the limited depth of field. 

• Problems with shadowing particles. 

D. Digital in-line holography 

The digital in-line holography method represents a 
completely different approach from any conventional 
imaging techniques. The volume of interest is illumi- 
nated by a high quality, wide, single mode laser beam. 
As the laser light is scattered on the levitating particles, 
a small fraction of it forms interference rings, which fall 
on a digital image sensor. During the analysis of the im- 
ages the center position of the rings give the horizontal 
and vertical coordinates of a particle, while the depth has 
to be computed from the interference ring structure^. 

Advantage: 

• No lens distortions, as no optics at all is involved. 
Disadvantages: 

• Numerically very demanding reconstruction. 

• Very high dynamic range (16 bit or more in in- 
tensity) needed to capture the faint interference 
ring structure on the background of the direct laser 
beam. 

• Very large area and high resolution detector needed 
to capture as much of the interference rings as pos- 
sible. 

• Slow: demonstrated so far only on static dust clus- 
ters with low particle number and large particle 
sizes. 

As one can see from the introduction of the available 
techniques, there is no general solution. The optimal 
choice strongly depends on the specific properties of the 
system under investigation and the quantities of interest. 

III. DUSTY PLASMA EXPERIMENT 

Our dusty plasma experiments are carried out in a cus- 
tom designed vacuum chamber with an inner diameter of 
25 cm and a height of 18 cm. The lower, powered, 17 cm 
diameter, flat, horizontal, stainless steel electrode faces 
the upper, ring shaped, grounded aluminum electrode, 
which has an inner diameter of 15 cm and is positioned 
at a height of 13 cm. The experiments are performed in 
an argon gas discharge at a pressure p = 1.1 ± 0.05 Pa, 
at a steady gas flow of a few times 0.01 seem, with 
13.56 MHz radio frequency excitation of ca. 10 W power. 
Melamine-formaldehyde micro-spheres with a diameter 
d = 9.16 ± 0.09 (im are used. For illumination of the 
particle layer we use a 200 mW, 532 nm (green) laser, 
the light of which is expanded and enters the chamber 
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through a side window. Although the present work tar- 
gets 3D imaging, to provide a reliable reference we have 
chosen to test our technique on a medium size (about 
14 mm diameter) single layer dust cluster consisting of 
about 60 particles. The light field camera captures its 
images from the side with ca. 13° tilt angle to the dust 
particle layer, as shown in figure [TJ This configuration 
represents a test case, which makes the verification of the 
depth measurement possible. 
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FIG. 1. Schematics of the dusty plasma experiment. 1: pow- 
ered electrode, 2: illuminating laser (200 mW @ 532 nm), 3: 
grounded electrode, 4: Lytro camera, 5: dust particle cluster, 
6: / = 174 mm convex lens to shorten the working distance. 

The Lytro camera is, in fact, not much different from 
a usual compact digital camera. It has a 3280 x 3280 
CMOS sensor with a pixel size of 1.4 /im, a (RG:GB) 
Bayer color filter matrix, and a 12 bit analog to digital 
converter, as well as a zoom lens with a constant //2 
aperture. The most important difference is, that in front 
of the CMOS sensor, at about 25 /an distance an array 
of micro-lenses is mounted. The micro-lenses of about 
14 /im in diameter form a triangular lattice. This design 
enables to compute the light field function Lp(s,t,u,v), 
which gives the light intensity arriving at the detector 
coordinates (s, t) from the position (u, v) of the objective 
lens, as illustrated in figure [5J In other words, each micro- 
lens projects the objective lens onto the set of detector 
pixels situated behind it, thus each sensor pixel measures 
the light intensity that has entered the camera through 
a specific point (u, v) of the objective lens and impacted 
a specific micro-lens with coordinates (s,t). 



IV. IMAGE PROCESSING AND PARTICLE DETECTION 

Light field cameras use wide aperture lenses, thus have 
a narrow depth of field, much shorter than the diameter 
of the dust particle cloud in our dusty plasma experi- 
ment. As a consequence, particles within the depth of 
field appear as bright points in the image, while particles 
situated closer to, or further away from the camera show 
up as faint blurred blobs. The actual intensity profile 
produced by these out-of-focus particles (called bokeh in 
photography) depends strongly on the properties of the 




FIG. 2. Schematics of the optical configuration of the light 
field camera (not to scale). 1: world plane, 2: objective lens, 
3: micro-lens array, 4: CMOS sensor array, W: working dis- 
tance, F: distance between the objective lens and the image 
plane. Light rays from different world plane points fall on 
different micro- lenses (rays with solid vs. dashed lines), while 
rays originating from the same points of the world plane and 
passing the objective lens at different points (e.g. the rays 
shown by solid lines) fall on different sensor pixels behind a 
given micro-lens. 



objective lens. To obtain the three dimensional coordi- 
nates of each particle we perform the following logical 
steps: 

1. Compute refocused images representing different 
depth layers from the light field function (the core 
concept of light field photography 14 ). This way we 
obtain a series of images with working distances W 
scanning through the dust particle cloud. 

2. Measure the apparent brightness B, and central 
coordinates (x, y) of all observable particle projec- 
tions on every image. 

3. Interpolate B versus W and find Wi which max- 
imizes Bi, where the index i labels the particles 
within the cloud. Once found, Wi is equal to the 
z (depth) coordinate of particle i, while the (x,y)i 
(world plane) coordinates are found from simple in- 
terpolation of the measured values to Wi. 

The first step of implementing the refocusing proce- 
dure is to construct a look-up-table (LOT) that correctly 
associates the four dimensional coordinates (s, t,u, v) to 
each and every sensor pixel of interest. The LOT is 
unique to each camera and is independent of the expo- 
sure, thus has to be constructed only once. Here we 
recall, that we use green (532 nm) illumination of our 
dust cloud, thus in the following we process only pixels 
behind the green color filters of the Bayer matrix, which 
is exactly half of the total sensor pixels. To construct 
the LOT, important calibration information is needed, 
which can be found in the header section of the raw 
image files, downloadable from the camera (like angu- 
lar misalignment and offset of the micro-lens array, pixel 
and lens pitch values, etc.). Using the LOT, the light 
field function Lp(s, t, u, v) belonging to an exposure can 
be constructed. 

With the light field function in hand the computation 
of the primary 2D image (as exposed) is possible based 
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on the numerical evaluation of the integral projection ex- 
pression 

Ep(s,t) — J J Lf(s, t, u, v) cos 4 4> dudv, (1) 

where Ep(s,t) is the monochromatic 2D image, F is the 
distance between the objective lens and the sensor plane, 
4> is the angle between the incident ray and the optical 
axis and is purely a geometrical factor independent of 
the actual exposure. The integration runs over the open 
aperture of the objective lensi^. 

Refocusing is introduced by virtually shifting the im- 
age plane distance F to F' — aF. In this case the 
light field function is transformed as LF>{s,t,u,v) = 
L a p{s,t,u,v) = Lp{u + (s — u)/a,v + (t — v)/a,u,v), 
and the 2D projection formula changes to^ 4 -: 

E aF(s,t) = J J COS 4 ^) (2) 

Lp [u + (s — u)/a, v + (t — v)/a, u, v] dudv. 

The evaluation of these integrals is performed numer- 
ically, discretising them using the LOT pre-constructed 
for the particular camera. As each micro-lens projects 
the main lens onto the sensor pixels behind it, the dis- 
crete [u, v) main lens coordinates are obtained by 

u = /3Ax + L x (3) 
v = PAy + L y , 

where j3 is a magnification factor (approximately the ra- 
tio of F and the focal length of the micro-lenses) taken 
from the calibration information of the camera, Ax and 
Ay are the relative coordinates of the sensor pixels to the 
centre of the corresponding micro-lens, L x and L y are the 
relative coordinates of the centers of the corresponding 
micro-lens to the optical axes of the camera. 

To optimize the computations the discrete values of 
(s, t) are chosen corresponding to the centers of the 
micro-lenses, which form a triangular lattice. The vir- 
tually refocused 2D images are results of barycentic in- 
terpolations of the computed E a p(s, t) intensity maps for 
a series of a parameters. 

For our first benchmarking experiment we have com- 
puted 40 virtually refocused images from a single expo- 
sure. Figure [3] shows three selected cases to illustrate 
the capabilities of our image processing algorithm. The 
centre image is the one seen on the raw image before 
any refocusing. In this image only particles situated at 
"medium" distances show up sharply as the camera was 
focused at the centre of the dust particle cloud. 

Before we preform the particle detection in each image, 
we make benefit from another possibility offered by the 
light field technique, namely the "digital stepping-down" 
of the image simply by constricting the integration in eq. 
([T]) to a small part of the main lens. The sub-aperture 
image computed this way has an enhanced field of depth 
for the price of higher noise level, which can be reduced 
by applying a Gaussian blur filter, as shown in figure 
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FIG. 3. Inverted and enhanced contrast images computed for 
a = 0.987, 1.0, and 1.013 (from top to bottom) from a single 
exposure. 



ID The multiplication of the refocused images with the 
sub-aperture image significantly enhances the apparent 
brightness of the particles in the vicinity of the field of 
depth relative to the unfocused ones. 




FIG. 4. Sub-aperture (enhanced field of depth) image. 



Particle detection is performed in these multiplied im- 
ages applying the widely used momentum method 15 . Be- 
sides the (x, y) coordinates of the particles identified in 
each image, the apparent brightness (defined as the av- 
erage intensity per pixel) of each particle is recorded as 
well. After identifying corresponding particles on sub- 
sequent images, the brightness function Bi(a) for each 
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particle can be constructed. A few examples are shown 
in figure [5] 
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FIG. 5. Examples of Bi(a) brightness functions for four rep- 
resentative particles. 
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FIG. 7. Overlay of the sub-aperture image, apparent (a;, y) 
coordinates (blue crosses), and the tilted 3D particle coordi- 
nate projections (red crosses). 



The position of the maxima of the Bi(a) brightness 
functions determine the oti parameters, which represent 
the particles' depth coordinate relative to the original 
working distance of the objective lens. After calibrat- 
ing the apparent pixel sizes on the images to the phys- 
ical measures of the dust particle cloud, the absolute z 
(depth) coordinate can be determined. Figure [6] shows 
the top view of the depth reconstructed dust particle 
cloud, while figure [7] shows and an overlay of the sub- 
aperture image and the projected particle coordinates to 
demonstrate the accuracy of our algorithm. 
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FIG. 6. Top view of the dust particle cloud projected from 
the full 3D coordinate set. 

The quantitative comparison of the apparent 2D and 
the projected 3D coordinates shows, that the depth 
measurement has an uncertainty (standard deviation) of 
ca. 7% of the apparent inter-particle distance, which is 
4 times higher than that of the 2D (ar, y) coordinates, 
which can be assumed to be 1 image pixel. This ac- 
curacy is comparable to that of other techniques, and 
further improvements are expected with the fine-tuning 



of our algorithm, and further advances of the light-field 
technique. 

Furthermore, this technique provides the possibility 
to resolve depth coordinates of particles shadowing each 
other. Particles with (a;, y) coordinates very close to each 
other, but significantly different z positions (depth) will 
appear with maximum brightness at different refocusing 
parameters a. In this case, the Bi(a) brightness func- 
tions should show multiple peak structures, where each 
of the maxima represents the z-coordinate of an individ- 
ual particle. 
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